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Abstract 

Based on the Fokker-Planck and the entropy balance equations we have 

studied the relaxation of a dissipative dynamical system driven by external 

Ornstein-Uhlenbeck noise processes in absence and presence of nonequilibrium 

constraint in terms of the thermodynamically inspired quantities like entropy 

flux and entropy production. The interplay of nonequilibrium constraint, 

dissipation and noise reveals some interesting extremal nature in the time 

dependence of entropy flux and entropy production. 
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I. INTRODUCTION 



Understanding of the nature of nonequilibrium and equilibrium states of a dynamical 
system in presence of surroundings is always an intriguing issue of physics. Entropy is an 
important quantity in this regard in thermodynamics. While in the traditional classical 
thermodynamics, the specific nature of a stochastic process is irrelevant, this may play an 
important role for establishing the connection between the phase space of a dynamical system 
and the related thermodynamically inspired quantities like entropy production, flux and 
Onsagar coefficients etc. Recently a number of authors PHTT|] have explored the relationship 
in considerable detail. 

The aim of the present paper is to enquire in this connection about the imprints of 
color [0], white and cross-correlated noise processes [0,0 on time dependence of entropy, 
entropy production and entropy flux using a connection between the information entropy 
and the probability distribution function of the phase space variables for thermodynamically 
open systems. Based on a Fokker-Planck description of stochastic processes and the entropy 
balance equation we first consider here the relaxation of a dissipative dynamical system in 
presence of the noise processes to a steady state from a given nonequilibrium state in terms 
of thermodynamically inspired quantities. For additive white noise we compare our results 
in the equilibrium state with the standard results for the closed systems. We also enquire 
how the system relaxes if the system is thrown away from the aforesaid steady state by a 
nonequilibrium constraint to understand how the entropy flux and the entropy production 
pass through minima with time in the later case and how the two relaxation processes for 
different noise properties differ. 

The outline of the paper is as follows: In Sec. II we calculate the entropy flux and the 
entropy production for a simple dissipative dynamical system in the nonequilibrium state 
for different noise processes. The paper is concluded in the Sec. III. 
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II. THE FOKKER-PLANCK DESCRIPTION, TIME DEPENDENCE OF 
ENTROPY FLUX AND PRODUCTION OF NOISE-DRIVEN DYNAMICAL 

SYSTEMS 



A. Relaxation of the noise-driven dynamical system to the steady state 

1. Ornstein-Uhlenbeck noise process 

We consider the dynamics of a dissipative dynamical system driven by the external 
Ornstein-Uhlenbeck noise process in the phase space. The relevant Langevin equation of 
motion can be written as 

X = - 1 X + i 1 (1) 

where 7 is the damping constant. The term 77 in Eq.(l) is the external Ornstein-Uhlenbeck 
noise whose two time correlation is given by 

fo(*MO> = f e*p(-^^) • (2) 

D is the noise strength and r corresponds to the correlation time of colour noise process. 
The time evolution of rj can be conveniently expressed in terms of the Gaussian white noise 
process ((t) as 

rj = -- + —( (3) 
(C(f)C(0> = 2eS{t - t') 

and 

(0 = ; , 

here the parameter e is used to identify the noise strength. 

Now treating rj as a phase space variable on the same footing as X we can write Fokker- 



Planck in the extended phase space |L2j as 



dp(X 1 ,X 2 ,t) dX^ _ dp_ ldX^p DcPp_ 

dt 7 dx l 2 9Xi r dx 2 +e r 2 dxl 1 ] 

where X 1: X 2 refer to X and rj in Eq.(l) and p(X 1: X 2 ,t) is the extended phase space 
probability distribution function. 

Now making use of the following transformation 

U = aX 1 +X 2 , (5) 

The Fokker-Planck Eq.(4) can be written as 



dt ~ dU s dU 2 ' 



where 



F = -XU , (7) 



AC/ = - f aX 1 - aX 2 + — , (8) 

T 



and 



Here a and A are constants to be determined. Using Eq.(5) in Eq. (8) and comparing 
the coefficients of Xi and X 2 we find 

A = 7 and a = 1 ~ 1T . (10) 

T 

We are now in a position to define entropy flux and entropy production using Eq.(6). 
In the microscopic picture the Shannon form of the entropy is connected to the continuous 
probability distribution p as 

S = - J p(U,t) In p(U,t)du (11) 
The time evolution equation for entropy then can be written as 



dt 



dFp d 2 p 



+ eD s 



hip (12) 



dU ' " s dU 2 

Putting the usual boundary conditions into the result of partial integration of the right 
hand side of the above equation (12), one obtains the following form of information entropy 
balance 
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dS_ 
~dt 



Eq.(13) implies that the first term has no definite sign while the second term is positive 
definitely since D s is always positive. Then one can identify the first and the second terms 
as entropy flux (Sp) and entropy production (Sp), respectively 

dF 



S f 



Jp^dU (14) 



^ = eD 'I- P {wf du (15) 

To find the explicit time dependence of these quantities we then search for the Green's 
function or conditional probability solution for the system at U at time t for the given initial 
condition 

p(U,t = 0) = — exp[-ei(C/- U'f] (16) 

71 

We now look for a solution of the Eq.(6) of the form 

p(U,t\U',0)=ex V [G(t)] (17) 

where 

G(t) = ~(U-P(t)) 2 + ^(t) (18) 

We will see that by suitable choice of (3(t), a(t), v{t) one can solve Eq.(6) subject to the 
initial condition 

p(U,0\U',0) = -exp[-e 1 (U -U') 2 } . (19) 

7T 



Comparing Eq.(19) with (17) and G(0) we have 

(7(0) = (3(0) = U>, 1/(0) = ^ . (20) 

If we put (17) in (6) and equate the coefficients of equal powers of U we obtain after 
some algebra the following set of equations 

a(t) = -27<r(t) + AeD s (21) 

0(f) = - 7 /J(f) (22) 

! v(t) = TT<r(t) (23) 



v(t) v y 2a(t) 

The relevant solutions of a(t) and /3(t) for the present problem which satisfy the initial 
conditions above are given by 

a(t) = ^^(1 - exp(-2 7 t)) + <t(0) exp(-2 7 t) (24) 

7 

and 

/3(f)=/3(0)exp(- 7 t) (25) 

Now making use of Eqs. (17), (24) and (25) in Eqs.(14) and (15) we finally obtain the 
explicit time dependence of the entropy flux and the entropy production as 

S F = -7 (26) 

and 

a ?eD 

P r=»[^ + ((7(0)-^)exp(-27*)] 

respectively, where we have used D s = ^. Thus entropy flux is negative and is independent 
of time, noise strength and correlation time. But entropy production decreases monotonically 
almost exponentially with time for a given set of D,t and 7 as shown in Fig.l and finally 
reaches to the limiting value 7 at the long time satisfying (Sp = —Sp) 
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^ = S F + S P = . (28) 

We now examine the connection between the thermodynamic entropy production and 
the phase-space collapse of the systems in nonequilibrium stationary states. In this state 
= and we have from Eqs. 13, 14 and 15 (for details see Ref. [7]) 

dF 



S P = -S F = - J PgjjdU = -divF™ = -a' + 0(e) > (29) 

in the limit e << 1. Here a' is the lyapunov exponent of the one dimensional deterministic 
system. Thus information entropy as defined by Eq.(15) is equal to the negative of Lyapunov 
exponent or equivalently to the rate of phase space volume contraction plus a correction term 
vanishing as the noise strength goes to zero |15|JI6|| . The results in Eq.(29) is very much 
interesting, since it would seem at first sight from Eq.(15) that Sp should tend to zero as 
e — > 0. The fact is that it nevertheless gives a finite contribution in this limit which reflects 
the nonanalytic dependence of the probability density on e [7]. 

2. Cross- correlated noise process 

We now consider another case where a simple dissipative system is driven by both additive 
and multiplicative white Gaussian noises 

X = - 1 X-( 1 X + Vl (30) 

The correlation between the noise processes are given by 

(C 1 (t)( 1 (t')) = 2eD'8(t-t') 

(r h (t)m(t')) = 2ea5(t-t') 

(Ci(t)Vx(t')) = (&(*%(*)> = 2A ie v^5(t - 0, < Ax < 1 (31) 

where Ai denotes the cross-correlation of the two noise processes. The Fokker-Planck equa- 
tion for the Langevin Eq.(30) can be written as (for details see ||) 



dp _ dFp d 2 p 

m~~^x +eDl dx^ (32) 

where the drift term is 

F = -TX + I (33) 

and 

D l = [a 7 2 + (2 - v)eD'a{{2 - v)eD' + 2 7 - 2 7 A X 2 - A : 2 (2 - v)eD'}]/Y 2 (34) 

with 

T = 1 + 2eD'-v ,l = (2-v)\ 1 e^D 7 a (35) 

In Eqs. (34) and (35) v — 1 stands for the Stratonovich and v = for the Ito convention. 

The Fokker-Planck equation (32) is very similar to Eq.(6). Following the earlier method 
the time dependence of entropy flux and entropy production for the cross-correlated noise- 
driven process is 

S F = -r (36) 
• 2D ± 



(37) 



where 



°i(t) = ^ + MO) - ^) exp(-2n) (38) 

Here o"i(0) has the same significance as in Eq.(24). Thus entropy flux for the cross- 
correlated noise process is time independent but its value not only depends on dissipation 
constant 7 as in the previous case but also on the strength of multiplicative noise(-D'). The 
time dependence of entropy production is qualitatively same as in the Fig.l but the relax- 
ation time is different since T contains both 7 and D' . In the long time limit Eqs. (36) and 
(37) satisfy Eq.(28). Since Eqs. (6) and (32) are formally same, the connection betwen the 
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thermodynamic entropy production and the phase-space collapse of systems in nonequilib- 
rium stationary states for the correlated noise driven system should be similar to Eq.(29). 
Using D' — 0, Ai = 0, v — and a = jKT in Eq.(37) (K and T are Boltzmann constant 
and temperature, respectively) one can obtain the time dependence of entropy flux and 
production for thermodynamically closed system |T7| in the Markovian limit. 



B. Relaxation of small external force-driven steady state to the new steady state 



1. The Ornstein-Uhlenbeck noise process 



We shall now examine the time dependence of entropy flux and production during the 
relaxation of steady state to a new steady state for the system driven by an weak external 
force. To this end we consider the constant drift f e in Eq.(l) due to external force so that 
the total drift in Eq.(6) now becomes 



F = F (U) + hF 1 



(39) 



where F = —XU,Fi = af e and h is smallness parameter. When h = 0, p = p s , p s is the 
steady state solution of the Eq.(6). The deviation of p from p s in presence of nonzero small 
h can be explicitly taken into account once we make use of the identity for the diffusion 
term in Eq.(6) 



d 2 p 







dU 2 dU 



dU 



P- 



+ 



d_ 

dU 



d p 



(40) 



Now we are in a position to establish a connection between the entropy production of 
irreversible thermodynamics and the relevant quantities of the underlying dynamics in phase 
space for the present model following Ref.[7]. The explicit calculation using Eq.(40) shows 
that the information entropy balance Eq.(12) now yields 



dS 



dUlnp 



d(Fp) d_ ( pd\n Ps 

dU s dU\ dU 



(41) 



It is noted that the first , the second and the third integrals in Eq.(41) are of zeroth, 
first and second order, respectively, with respect to the deviation from steady state. Doing 
partial integrations in Eq.(41) we obtain 

d In p s \ 2 d In p d In p s 



dS 
~dt 



Such a new decomposition of the rate of change of information entropy now exhibits a 
part ASp 



■In 

Ps 

which is both positive definite and of second order in the deviation from the steady state, 
thereby fulfilling the principal condition required on entropy production. On the otherhand, 



ASp = eD s J dUp(— In > (43) 



the first term on the right-hand side of Eq.(42), divF 1 , has no definite sign and contains, in 
principle, contributions of all orders in the deviation from steady state. In the stationary 
state, ^ = 0, and the contribution of this term and of the second one in Eq.(42) must cancel 
that of ASp. The role of this latter term in this balance is, then, to remove the contributions 



of all but second orders in the deviation from steady state contained in divF 1 . 
We may therefore write, in the new steady state 



ASp = —divF 00 — (terms of 0th and 1st order in h). (44) 
So by virtue of Eq.(29) we have 

ASp = —a' — (terms of 0th and 1st order in h). (45) 

This establishes a connection between the irreversible thermodynamics on the one hand, 
and phase space dynamics on the other in the case when the dynamical system is externally 
driven by deterministic small term. 

We now return to Eq.(6) and consider the dynamics in presence of an additional force 
hF 1 (Eq.34) 

dp d<pp 8F lP d ( d p\ 

m = -mj- h ^iT + Ds mJ [ ps du7s ) (46) 
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where 6 is defined as 



D ^ (47) 



Here we have used e = 1 for the rest of the calculation. 
The steady state solution of Eq.(6) is 



A/7 2 

Ps = Nexp[-—] (48) 



where N is the normalization constant. 
Using Eq.(48) in (47) we have 



(49) 



To consider the entropy flux and the entropy production in the nonequilibrium state in 
presence of external forcing we use Eq.(46) in the time evolution equation of entropy(ll). 
Following Ref. |7[] we finally identify entropy flux (ASp) and entropy production (ASp) as 



AS P = D S ldUp{4r>-\ • ( r >U 



and 

... .V 

dU p s 

Here we have used 5p = p — p s and h — 1. 

In the next step we solve Eq.(46) as before to find the explicit time dependence of ASf 
and ASp. The time dependent solution of Eq.(46) is given by 

, = J V iexp[ -(£^p!] (52) 
a{t) 

where N\ is the normalization constant and a(t) is obtained from Eq.(24). The expression 
for Ph(t) is given by 

Ph(t) = y + G9 & (0) - y ) exp[-At] (53) 
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Now using Eqs.(48) and (52) in both (50) and (51) we have 

AS F = A- [2D S - Xa(t) + 2/3 h (-/3 h \ + Fx)] - ^-F^ h (54) 



and 

AS P = D s 



(55) 



where \, D s , <r(t), j3 h (t) and F\ are given by the Eqs. (10), (9), (24), (53) and (39) respec- 
tively. The time dependence of ASp is shown in Fig. 2 for different values of r for a given 
set of values of other parameters. It is interesting to note that for 77 ^ 1 the entropy 
production first decreases with time and then passes through the minima and finally reaches 
to the following steady value f| which is shown by solid curve of Fig. 2. 

AS P = 1 ^ J /e = —ASp (56) 

This observation can be explained by simplifying Eq.(55) in the limit cr(0) — ► and 
P h (t) -> as 

1 



AS f 



(1 - 7 r) 2 / e 2 (1 - 2e~ 7 * + 2e' 37i - e~ 47i ) + 1 De~ A ~ it (57) 



D(l - exp(-2 7 t) 

In Eq.(57) first term in the numerator which vanishes as t — > implies that the external 
force increases entropy production while the second term corresponds the decrease of entropy 
production with time due to dissipative action. Because of these two opposite effects a system 
thrown away from a steady state by a small external force relaxes to a new steady state 
passing through a minima in entropy production with time for the case 71^ 1. For jt = 1 
entropy production decreases monotonically since the effective external force becomes zero 
under this condition. Similarly entropy flux also show extremum properties for 77 / 1 case 
which is shown in the solid curve of Fig. 3. Dotted curve of this figure corresponds to the 
time dependence of entropy flux for jt = 1. Another interesting point which should be 
noted here is that and ASp or ASp reach their equilibrium values at different times 
(the plot of ^ vs t is shown in the inset of Fig. 2). Thus Fig.2 implies that before the true 
stationary state is reached the system may show ^ = 0. 
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In the Markovian limit r — > so that Eq.(57) reduces to 

1 



AS f 



f 2 e {\ - 2e" 7 * + 2e" 37 * - e" 47i ) + ^De^ (58) 



D(l - exp(-27t)) 

The above equation implies that even for white noise entropy production passes through 
the minima with time for both thermodynamically open and closed (D = ^KT) systems 



T7fl . As t — > oo the Eq.(58) reduces to 



ASp = & (59) 

For D = ^KT the above equation reduces to the standard result for entropy production 
of irreversible processes for a Brownian oscillator. 

Eq. (57) further implies that for t > the entropy production ASp passes through mini- 
mum at 7T = 1 which is shown in Fig.4. The variation of ASp with r in Eq.(54) shows the 
maximum as evident in Fig. 5. These extremal behaviour is not observed for h = 0. 

Now to show the effect of 7 on the interplay between 7 and r we plot both ASp vs 7 
and ASp vs 7 using Eq.(55) and (54). Both the figures show extremum properties but Eqs. 
(26) and (27) do not exhibit such kind of variation. It is thus apparent that in presence 
of the nonequilibrium constraint the properties of noise processes as well as the dynamical 
characteristic of the system are important for both entropy flux and production. 

2. Cross- correlated noise driven process 

We now turn again to the cross-correlated noise driven process to study the time de- 
pendence of entropy flux and entropy production due to additional weak forcing on the 
stationary system. To this end we add a constant of force f e in the Eq.(30) 

X = - 1 X-( 1 X + Vl + hf e (60) 

The Fokker-Planck equation corresponding to Eq.(60) can be written as 
dp dfap df e p d ( d p\ 

~dt = ~~dX~ ~ ~dX~ dX { Ps dXj s ) (61) 
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where 



<f> 1 = F-D 1 



din p s 

dX 



(62) 



F is given by Eq.(33) and p s is stationery solution of Eq.(32). Using p s in <pip s again we 
have 



(f>iPs = 



(63) 



Since Eq. (61) is very much similar to the Eq.(32), the time dependence of entropy flux 
and entropy production can be derived as before to obtain 



AS F 

and 

ASp = D 1 



2D 1 



2D, - Ta^t) + 2(P' h - l -){-P' h T + l + f t 



(64) 



[ D, a 1 (t) ){( J D 1 <7i(f) )(/ ^ 



<Ji(t). 



+ 2 



I 



i 



ai{t) L>i o x Di 



(65) 



where 



m = (m - ^) exp(-rt) + ^ 



(66) 

Eqs.(65) and(64) also show extremal properties as shown by solid curves in Figs. 2 and 
3. The variation of both ASp and AS P with noise correlation strength Ai in Eqs. (64) and 
(65) is shown in Figs. (9) and (8) respectively at t — 0.5. Although both the figures show 
extremal behaviour in the nonequilibrum state but at the stationary state ASp increases 
and ASp decreases monotonically. Thus the interplay between 7, noise strength and cross- 
correlation strength in the nonequilibrium state is different from that in the stationary state. 
Before leaving this section we mention here that our calculated entropy flux and entropy 
production are exact since the models considered here are linear and are exactly solvable by 
Greens' function of Gaussian form. 



14 



III. CONCLUSIONS 



In this paper we have explored the interplay between dissipative characteristics of the 
dynamics and noise properties in presence and absence of nonequilibrium constraint in the 
nonequilibrium state as well as in the stationary state in terms of entropy flux and entropy 
production. Both the entropy production and the entropy flux show extremal properties 
with time for color noise processes when the product of correlation time and dissipation 
constant is not equal to one in presence of a nonequilibrium constraint. The white and 
the cross-correlated noise driven processes also mimic this extremal nature. This is due 
to a competition between the nonequilibrium constraint and the dissipative action. The 
maxima and minima are also found in the variation of both ASf and ASp with correlation 
time and dissipation constant for the color noise driven processes in the nonstationary and 
the stationary states but this feature can be found in the variation of AS F and AS P as 
a function of correlation strength Ai only in the nonstationary state. Since white, color 
or cross-correlated noise driven processes concern many situations in biology physics and 
chemistry we hope that our present observation will be useful for understanding the close 
connection between irreversible thermodynamics and dynamical system in many related 
issues. 
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FIGURES 

FIG. 1. Plot of entropy production (S P ) vs time using Eq.(27) for cr(0) = 0.1, D = 0.5, 
7 = 1.0. Solid and dotted curves are for r = 2 and 1 respectively (Units are arbitrary). 

FIG. 2. Plot of entropy production (ASp) vs time using Eq.(49) for the same parameter set 
as in Fig.l and (3h(0) = 1.0 and f e = 1.0. r = 2 and 1 for solid and dotted curves. In the inset 
the sum of ASp and ASp from Eqs. (49) and (48) is plotted against time for r = 2 (Units are 
arbitrary) . 

FIG. 3. Plot of entropy flux (ASp) vs time using Eq.(48) for the same parameter set as in 
Fig. 2 r = 2 and 1 for solid and dotted curves (Units are arbitrary). 

FIG. 4. Plot of entropy Production (ASp) vs r using Eq.(49) for the same parameter set as 
in Fig. 2 at t = 0.5 (Units are arbitrary). 

FIG. 5. Plot of entropy flux (ASf) vs r using Eq.(48) for the same parameter set as in Fig.2 
at t = 0.5 (Units are arbitrary). 

FIG. 6. Plot of entropy Production (ASp) vs 7 using Eq.(49) for the same parameter set as 
in Fig.2 and r = 2 at t = 0.5 (Units are arbitrary). 

FIG. 7. Plot of entropy flux (ASf) vs r using Eq.(48) for the same parameter set as in Fig.6 
at t = 0.5 (Units are arbitrary). 

FIG. 8. Plot of entropy Production (ASp) vs Ai using Eq.(59) for a x = 0.0, 0' h = 0.0, D' = 1.0, 
a = 1.0 and 7 = 1.0 at t = 0.5 (Units are arbitrary). 

FIG. 9. Plot of entropy flux (ASf) vs Ai using Eq.(58) for the same parameter set as in Fig.8 
at t = 0.5 (Units are arbitrary). 
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